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^^ . Abstract. We introduce a setup of model uncertainty in discrete time. In this 

setup we derive dual expressions for the super— replication prices of game op- 

£Nj ' tions with upper semicontinuous payoffs. We show that the super— replication 

price is equal to the supremum over a special (non dominated) set of martin- 
gale measures, of the corresponding Dynkin games values. This type of results 
is also new for American options. 
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1. Introduction 



O" 1 A game contingent claim (GCC) or game option, which was introduced in [10j . 

is defined as a contract between the seller and the buyer of the option such that 
both have the right to exercise it at any time up to a maturity date (horizon) T . If 
the buyer exercises the contract at time t then he receives the payment Y t , but if 
the seller exercises (cancels) the contract before the buyer then the latter receives 
X t . The difference A t — X t — Y t is the penalty which the seller pays to the buyer 
for the contract cancellation. In short, if the seller will exercise at a stopping time 
a < T and the buyer at a stopping time r < T then the former pays to the latter 
the amount H(a, r) where 



o 

m ; H(a, t) = A CT I CT<T + Y T \ T <a 

and we set \q = 1 if an event Q occurs and Iq = if not. 

A hedge (for the seller) against a GCC is defined as a pair (ir, a) that consists 
K^ ' of a self financing strategy -k and a stopping time a which is the cancellation time 

;_h . for the seller. A hedge is called perfect if no matter what exercise time the buyer 

chooses, the seller can cover his liability to the buyer. 

Until now there is quite a good understanding of pricing game options in the 
case where the probabilistic model is given. For details see [TT] and the references 
therein. However, so far super-replication of American options and game options 
was not studied in the case of volatility uncertainty. In fact, super-replication 
under volatility uncertainty was studied only for European options (see, [6], [7], 
[13], [H] and [H]). I n the papers (see, [7], [H] and [TH]) the authors established 
a connection between G-expectation which was introduced by Peng (see [16] and 
[lTj ) . and super-replication under volatility uncertainty in continuous time models. 
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2 Y.Dolinsky 

In this paper we introduce a discrete setup of volatility uncertainty. We consider 
a simple model which consists of a savings account and of one risky asset, and we 
assume that the payoffs are upper semicontinuous. Our main result says that the 
super-replication price is equal to the supremum over a special (non dominated) set 
of martingale measures, of the corresponding Dynkin games values. In continuous 
time models, the problem remains open for American options and game options. 

Main results of this paper are formulated in the next section. In Section 3 we 
prove the main results of the paper for continuous payoffs. This proof is quite 
elementary and does not use advanced tools. In section 4 we extend the main 
results for upper semicontinuous payoffs. This extension is technically involved and 
requires the establishment of some stability results for Dynkin games under weak 
convergence. 

2. Preliminaries and main results 

First we introduce a discrete time version of volatility uncertainty. Let N £ N, 
s > and / = [a, b] C M+. Dchnc the set K C K^ 1 by 

K = {(xq,...,Xn) ■ x — s, lnxj+i - lnccjj £ I, i < N}. 



The financial market consists of a savings account B and a risky asset S (stock). 
The stock price process is S k , k = 0, 1, ...,N, where N < oo is the maturity date 
or the total number of allowed trades. By discounting, we normalize B = 1. We 
assume that the stock price process satisfies (So, ...,Sn) £ K. Namely the initial 
stock price is So = s and for any i < N we have | lnSj+i — In Si £ I. This is the 
only assumption that we make on our financial market and we do not assume any 
probabilistic structure. 

For any k — 0, 1, ..., iV let F k , G k '■ K — > M + be upper semicontinuous functions 
with the following properties, for any u,v £ K, Fk(u) = Fk(v) and Gk(u) = Gk(v) 
if m — Vi for all i = 0, 1, ..., k. Furthermore, we assume that Fk < Gk- 

Consider a game option with the payoff function 

(2.1) m(kJ,S) = G k (S)l k<l +F l (S)l l < k , k,l = 0,1,.. .,N. 

Observe that M(k, I, S) is the reward that the buyer receives given that his exercise 
time is I and that the seller cancelation time is k. Furthermore, the reward H(fc, I, S) 
depends only on the stock history up to the moment k A I. 

In our setup a portfolio with initial capital a; is a pair 7r = (x, 7) where 7 : 
{0, 1, ...,iV — 1} x K — > K is a progressively measurable process, namely for any 
k = 0,1, ..., N — 1 and u,v € K, "f(k, u) — j(k, v) if u, = Vi for all i = 0,1, ..., k. 
The portfolio value at time k is given by 

fe-i 

(2.2) V£(S)=x + J2'y(i,S)(S i+1 -S i ), S e K, k = 0,l,...,N. 

i=0 

A stopping time is a measurable function a : K — > {0, 1, ..., AT} which satisfies 
the following, for any u G K and k = 0,1, ..., N if u(u) = k then a(v) = k for any 
v with Vi = Ui for all i = 0, 1, ..., k. 

A pair (tt, a) of a self financing strategy 7r and a stopping time a will be called 
a hedge. A hedge (it, a) will called perfect if 

(2.3) V: {S)M (S)>W(<j(S),l,S), VSeK, l = 0,l,...,N. 
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The super-replication price is given by 
(2.4) 
V = inf {Vq\ there exists a stopping time a such that (ir, a) is a perfect hedge} . 

Observe that we do not have any underlying probability measure, and we require 
to construct a super-hedge for any possible values of the stock prices. Similar setup 
(but not the same) was studied in [6] for European options. 

We make some preparations before we formulate the main result of the paper. Let 
Z = (Z , ..., Zn) be the canonical process on the Euclidean space K-^" 1 " 1 . Namely 
for any z — (z , ..., Zn) £ M Ar+1 and k < N we have Z k {z) = z k . A probability 
measure P supported on K is called a martingale law if for any k < N 

(2.5) E P (Z N \Z {h ...,Z k ) = Z k P a.s. 

where E P denotes the expectation with respect to P. Denote by M. the set of all 
martingale laws. Clearly, M. ^ 0. For instance the probability measure P/, which 
is given by 

P b (Z = s) = 1 and 

P 6 (ln Zi+i - In Zi = b) = l- P fc (ln Z l+1 - In Z t = -b) = £&, * < N, 

is an element in Ai. 

Let J~k = ct(Zq, ..., Zk), k < N be the canonical filtration, and let 7" be the set 
of all stopping times (with respect to the above filtration) with values in the set 
{0,l,...,iV}. _ 

The following theorem is the main result of the paper. 

Theorem 2.1. The super-replication price is given by 

V = info-gr suppg^ sup rer E P H(cr, t, Z) = 
sup Pe M inf CTe r su P r eT E rH(cr, r, Z) = sup Pe M sup r eT inf aeT E P H(cr, r, Z) . 

It is well known that inf sup > sup inf, thus in order to prove Theorem 12.11 it is 
sufficient to prove the following relations 

(2.6) V < sup sup inf E P H(a,r,Z) 

P£MT€T< je7 ~ 

and 

(2.7) V> inf sup sup E P H(<7, r, Z). 

vtTpeMTeT 

The first inequality is the difficult one and it will be proved in Sections 3-4. The 
second inequality is simpler and we show it by the following argument. 

From (|2.4[) it follows that for any e > there exists a perfect hedge (it, a) with 
an initial capital Vq = V + e. From (|2.2[) we get that for any P £ M the stochastic 
process {V^(Z)} k=Q is a martingale with respect to P. Observe that <r{Z) £ T, 
and so from (|2.3p we obtain that for any r £ T 

V + e = V£ = E r V£ (z)AT > E p H(ct(Z), t, Z). 

The terms P £ M and r £ T are arbitrary, thus we conclude that 

V + e> sup supE P H(5-(Z),r,Z) > inf sup sup E p H(ct, r, Z). 

PGMreT CTe7 "PeA4 r£T 

By letting ejOwe derive (|2~7l) . D 
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Remark 2.2. From Theorem 2.1 we obtain the following probabilistic corollary. 
inf sup sup EpH(cr, t, Z) = sup sup inf EpH(<7, r, Z). 

This corollary is not obvious since the set M. is a set of non dominated probability 
measures, and so it does not follow from the results in [12] . 

3. Proof of the main result 



This section is devoted to the proof of (J2.6I) . for the case where the functions 
Fk, Gfe : K —} M + , k < N are continuous. 

3.1. Discretization of the space. Let n G N. Introduce the set 

K n :— {(xo, -;Xn) ■ x = s and 
| lnxi+i — lnxi\ € {a,a+ (b — a)/n,a + 2(6 — a)/n, ...,b}}. 

Consider a multinomial model for which the stock price S — (So, ■ ■■, Sn) lies in the 
set K n . As before the savings account is given by B = 1. In this model a portfolio 
with an initial capital a; is a pair tt — (x, 7) where 7 : {0, 1, ..., N — 1} x K n — > K 
is a progressively measurable process. A hedge is a pair (ir, a) which consists of a 
portfolio strategy 7r and a stopping time a. A stopping time is a map a : K n -^ 
{0, 1, ...,N} which satisfies that if cr(u) — k then o~(v) = k for any v with vt = U{ 
for all i = 0, 1, ..., k. A hedge (tt, a) will called perfect if 

(3-1) VJ (S)Al (S)>M(a(S),l,S), VSeK n , l = Q,l,...,N 

where the portfolio value is given by the same formula as (|2.2[) . 

Let 
(3.2) 
V„ = inf {Vq\ there exists a stopping time a such that (it, a) is a perfect hedge} 

be the super-replication price in the multinomial model. Next, we introduce a 
modified super-replication price. Let M > and let Tm be the set of all portfolio 
strategies it — (x,j) where 7 : {0,1,..., A — 1} x K n -^ [—M,M]. Namely, we 
consider portfolios for which the absolute value of the number of stocks is not 
exceeding M. Consider the super-replication price 

V^ = inf {Vq^I there exists a stopping time a such that (71", a) is a perfect hedge} . 

7rer A f 

We will need the following technical lemma. 
Lemma 3.1. There exists a constant M > (which is independent of n) such that 

Vf = V n . 
Proof. Clearly, V, A / > V„. Thus its sufficient to show that V r f < V n . Set 

A = max sup Fh(x). 

0<k<N xeK 

Clearly there exists a perfect hedge with an initial capital A (in this case the investor 
does not trade and stop only at the maturity). Let (tt, a) be a perfect hedge in the 
sense of (|3.1[) . We will assume (without loss of generality) that the initial capital 
V V is no bigger than A > 0. Furthermore, since the option is exercised no later than 
in the moment tr(S'), we can assume (without loss of generality) that j(k,S) = 
for k > a(S). 
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First let us prove by induction that for any S £ K n and k = 0, 1, ..., iV, 

/ e b -l\ k A ( l + T^) k 

(3-3) V^ a{s) (S)<A(l + T —- b ) and | 7 (fe,5)| < ^ _ ^ ■ 

If (j = then the statement is clear. Thus we assume that a(S) > for any (er is 
a stopping time) S s i^«. Choose 5* G if„. Clearly, the portfolio value at time 1 
should be non negative, for any possible growth rate of the stock. In particular we 
have, 

V 7r (S)+j(0,S)s(e b ~l) >0 and V n {S) + 7 (0, S)s( e - b - 1) > 

and we conclude that |7(0, S)\ < s(1 _ e - b \ ■ Thus (|3.1j) holds for k = 0. Next, assume 
that (|3.3[) holds for k, and we prove it for k + 1. From the induction assumption 
we get 

V (k+l)A<r(S)( S ) = V 7a<t(S)( S ') +7(fc A Cr(S*),5)(5 (fc+ i )A(T( s) - Sfc A cr(S)) < 

4 1 + &)" + 4sS|^^ - 1) < a (i + ^)* +i , 

as required. Next, if a(S) < k + 1 then y(k + 1,5) = 0. If <r(S) > k + 1, then the 
portfolio value at time k + 2 should be non negative, for any possible growth rate 
of the stock. Thus, 

V£ +1 (S)+y(k + l,S)S k+l (e b -1) >0 and V£ +1 (S) +y(k + 1, S)S k+1 (e- b - 1) > 

and so, 

/ b \ k + l 



Mk + i,s)\< „ *+"' < 



(1 - e- b )S k+ i ~ (1 - e~ b )S k 



fe+i 



This completes the proof of (|3.3[) . Finally, observe that Sfc > se and so, we 
conclude that for M := As-^^ (l + f^pr) , we have \j{k,S)\ < M for all 
k,S. " D 

Now, we can easily prove the following lemma. 

Lemma 3.2. 

V < lim inf V„. 

n— >oo 

Proof. Fix e > 0. Let n G N. Consider the multinomial model for which the stock 
price process S — (So, ..., Sn) lies in the set K n . Let (7r,cr) be a perfect hedge for 
this multinomial model such that -k — (V„ + 6,7). From lemma [3~T1 it follows that 
we can assume that \ r y(k,S)\ < M for any fc, S. Consider the map ip n : K — ► K n 
which is given by tp n (yo, ■•■, ZA/v) = (xq, ..., xat) where 

.To = y a and for A; > lny i+ i = lny, : 
+sgn(lna: l+ i - lnx^a + (6 — a)[n(| ln:r i+ i - \nxi\ - a)/(b - a)]/n) 

where [v] is the integer part of v and sgn(v) = 1 for v > and = —1 otherwise. 
For the original financial market define a hedge (tt,o') by the following relations, 

7r = (V„ + 2e, 7) where 

(3.4) 7 (fc,S)=7(fc,Vn(S)) and &(£) = a(i/> n (S)), k<N,SeK. 



6 Y.Dolinsky 

Observe that 7 is a progressively measurable map and a is a stopping time. Thus 
(fr, a) is indeed a hedge for the original financial market. From the continuity of 
the functions F k ,G k , k = 0, 1, ..., N it follows that for sufficiently large n 
(3.5) 

\\S-MS)\\ + \Fk(S)-F k (MS))\ + \G k (S)-G k (MS))\ < 2]j^. S G K,k < N, 

where we denote \\(zq, ...,Zn)\\ = maxo<i<jv \z%\. Let S G K. Set Y^ n > = ip n (S). 
From (|3.5[) and the fact that 7 6 [— Af, M] it follows that (for sufficiently large n) 
for any I < N we get 

EL A =^ K1 7(fc,F(«))((5 fc+1 - S k ) (Kg - y("»)) > 

e + %(yW),J, y( fl >) _ 27V Af l^ _ y(")| > W(a(S), I, S). 

Thus for sufficiently large n, V < 2e + ¥ n . Since e > was arbitrary this concludes 
the proof. □ 

3.2. Analysis of the multinomial models. Fix n G N. Let Q = R N+1 . Define 
the piecewise constant stochastic processes 

S t (zq,...,Zn) := Z[„t]) ^t («0)—>«iv) =-P 1 [nt](^0,—,-2jv) 



and X t l " J =G [nt] (z ,...,z N ), zefi, tG[0,l]. 



1 



Let {J* } t= o De the filtration which is generated by the process S^- n \ The set 
K n C 51 is finite, and so, there exists a probability measure P„ on VL which is 
supported on K n and gives to any element in K n a positive probability. Thus 
we can apply Theorem 2.2 in [TJ] for a market with one risky asset S^ which 

lives on the probability space (J7,J-"} n , P„), and a game option with the payoffs 
y(") < x( n \ In this case the super-replication price coincides with V„ which is 
given by (|3.2[) . Thus let M. n C M. be the set of all martingale laws which are 
supported on the set K n and T be the set of all stopping times (with respect to the 

filtration {F t [ } t=0 ) with values in the set [0, 1]. From Theorem 2.2 in [TJ] and the 
fact that the processes Y^ n \ X^> are piecewise constant we obtain 

V„ = sup supinf E P (^" ) I (T<T +y T ( " ) I (T > T ) = sup sup inf E P H(cr,r, Z). 

Since A4 n C A4, we conclude that for any neN, 

V„ < sup sup inf E p H(o-,t, Z). 
PeMreT rTer 

This together with Lemma 13.21 completes the proof of (|2.6[) . □ 

Remark 3.3. An interesting question which remains open is the limit behavior 
where the maturity date N goes to infinity. Namely, for a given N £ N consider 
the interval I := I(N) = -j=,-j= . Our conjecture is that for regular enough 

payoffs the limit behavior of the super-replication prices V := V(N) as N — ► 00 is 
equal to a stochastic game version of G -expectation, defined on the canonical space 
C[0, T]. For European options the limit is the standard G -expectation, this follows 
from [5] and [9]. It seems that the tool which was employed in [5] can work for 
the American options case. In this case the limit of the super-replication prices is 
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equal to an optimal stopping version of G -expectation. However for game options 
the problem is more complicated. 

4. Extension for upper semicontinuous payoffs 

In this section we prove (12.6[) for the case where the functions Fk,Gk ■ K — > R+ , 
k < N are upper semicontinuous (and not necessarily continuous). 

Let A = maxo<fc<jv sup^g^ Gfc(x) < oo. By using similar arguments as in 
Lemma 5.3 in 8 it follows that for any k — 0, 1, ..., N there are two sequences of 
continuous functions {F^ }^ =1 and {G k n '}^ =1 which satisfy the following: 

(i). A > G k n) >G k ,A> Ft n) > F k and G k n) > F { k n \ for all n. 
(ii). 

(4.1) lim sup G[ n \x n ) < G [n) {x) and lim sup F^ n) (x n ) < F{x) 

n— >oo n— >oo 

for every x G K and every sequence {x„}^ =l C K with linin^oo x n = x. 

(iii). Furthermore, for any n G N and u,v £ K, F^ (u) = F^ n '(v) and G^ 1 (u) — 

G)?'(v) if Uj = Vi for all i = 0, 1, ..., fc. 

Let V be the super-replication price which corresponds to the payoff functions 
F, G, and for any n G N let Y n be the super-replication price which corresponds to 
the payoff functions fW, G< n ). 

From (i), it follows that for any n G N, V < V n . Thus from Theorem 2.1 (for 
continuous payoffs) it follows that 

V < lim inf sup sup inf E P H (n) (a, r, Z) 

where 

M^(k,l,S)^G[ n) (S)l k<l +F l {n \s)I l < k , k,l = 0,1, -,N, SeK. 

We conclude that in order to establish (J2.6I) we need to prove the following lemma. 

Lemma 4.1. 

sup sup inf EjpH(cr, r, Z) = lim inf sup sup inf EpH^(o", r, Z). 
PeMreT (je ' T ' n ^> 00 FeMTeT c ' e7 ~ 

Proof. From (i), 

sup sup inf E P H(cr, r, Z) < lim inf sup sup inf EpH^ (a, r, Z). 

P£MT£T ae ' T ~ n ^ oa P£MT£T c ' e7 ~ 

Thus we will prove that (infact this is the inequality that we need) 

(4.2) sup sup inf E P H(cr, r, Z) > lim inf sup sup inf E r M (n) (o; t, Z). 

For any n G N, let P n G M and p n G T be such that 

(4.3) sup sup inf E P U {n) (a, t,Z) <-+ inf E Pri H ( " ) (cr,p„, Z). 
PeMTeT aer n aeT 

Consider the set II of all probability measures on K, induced with the topology of 
weak convergence. Observe that II is a compact set (this follows from Prohorov's 
theorem, see [5] Section 1 for details). From the existence of the regular distribu- 
tion function (for details see [18] page 227) we obtain that there exist measurable 
functions h k n ' : R k+1 ->• II, k < N, such that for any Borel set A C K and n G N 



'7r 

F n ((Z ,...,Z N )£A\Z ,...,Z k ) = h)! l >(Z Q ,...,Z k )(A), P„ a.s. 
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For any n € N consider the distribution of (under the measure P n ) 
(p n ,Z , ..., Z N , h Q n (Z ), ..., h^_i(Zo, ..., Zn-i)) 

on the space [0,N] x K x H N with the product topology. 

Since the space [0,7V] x K x 11^ is compact then by Prohorov's theorem there 
is a subsequence which for simplicity we still denote by 

{p n , Z , ..., Z N , h^'(Z ), ..., h>x_i(Za, ..., Zn-x)), neN 

which converges weakly. Thus from the Skorohod representation theorem (see [3]) 
we obtain that we can redefine the sequence 

(p n ,Z ,...,Z N ,hl ™'(Z ),... ,h}p_ 1 (Zo ) ...,Zif-i)), nefi 

on a probability space (f2, J 7 , P) such that we have P a.s convergence 

(4.4) 

(p„,4"\...,Z^\4" ) (4"^...,4 l l 1 (z("\...,41j)^(p,^ ,...,^,^ 1 ,...,^). 
Redefining means that for any n£N the distribution of 

(pn,Zo, ..., Z N , Hq (Zo), ..., hjvLiOZo, •■•, Zn-i)) 
under P„ is equal to the distribution of 

under P. Let Q k = a{Uo,...,U k }, k < N be the filtration which is generated 

by Uq, ■■■, Un ■ Denote by Tu the set of all stopping times (with respect to this 

filtration) with values in the set {0, 1, ...,N}. Next we show the following three 

properties: 

(I). The distribution of (/To, ..., Un) (on the space K) is an element in M. 

(II). For any A;, the conditional distribution of (Uq, ...,Un) given Uo,...,U k equals 

toW k . 

(III). For any fc, the event {r = k} and Qn are independent given Q k . 

Denote by E the expectation with respect to P. From Lebesgue's dominated 
convergence theorem if follows that for any k < N and continuous bounded func- 
tions / : R fe+1 -> R, g : K -)• R we have 

(4.5) E((U N -U k )f(U ,...,U k )) = 
xxxrx n ^E((Z^ -Z^)f(Z^,..,,Z^)) 

= lim„^ 00 E P7i ((Z A r - Z k )f(Z ,...,Z k )) = 0, 

where the last equality follows the fact that P„ 6 M is a martingale distribution. 
From the definition of the topology on II, we also have 

(4.6) E(f(U ,...,U k )g(U ,...,U N )) = 
hm™ E(f(Z<?\ ..., zi n) )g(Z { n \ ..., Z^)) 

= \xm n ^E(f(Z^\...,Z^)Jg(y)h k n \z^\...,Z^)(dy)) 
= E(f(U ,...,U k )Jg(y)W k (dy)). 

By applying standard density arguments we obtain that (|4.5|) implies (I) and (|4.6j) 
implies (II). Next, fix k. From (II) and the fact that p n is a stopping time we obtain 
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that 

E(l p=k E(g(U ,...,U N )\g k )) = E{l p=k J g(y)W k (dy)) = 

lim n ^ 00 E(l Pn=k Jg(y)h k n \z^\...,Z ( k n) )(dy)) = 

]im n ^ x E(I Pn ^ k E(g(Z >\...,Z^)\Z^,...,Z^)) = 

limn.** E{g{Z^\..., Z<£ ] )I Pn = k ) = E{g(U 0l ..., U N )I p = k ), 

and again, from standard density arguments we conclude that 

E(i p=k \g k ) = E(i p=k \g N ) 

and (III) follows. Property (III) is important because it implies the following. For 
any stochastic process (Lo, •••) Ln) which is adapted to the filtration Q k , k < N , we 
have 

(4.7) EL p < sup EL T . 

reTu 

The proof of this implication can be done in the same way as in Lemma 3.3 in [4], 
and so we omit it. 

Now we arrive to the final step of the proof. Choose < e < 1. Let a £ Tjj be 
such that 

(4.8) inf EW(<7, p, U) > EU(a, p, U) - e, 
ceTu 

where U — (Uq, ..., Uji). For any k there exists a continuous function f k : R fc+1 — y R 
such that P{l d=k ^ f k (U ,...,U k )) < ^tt. For any n € N define a n = N A 

min{fc|/fc(Zg , ..., Z k ) > |}. Clearly a n is a stopping time with respect to the 

filtration generated by Zq , ..., Z i? ' . Let C be the following set 



C = {uj E il|3r7i := m(u>) such that Vn > m a n (u) = cr(w)}. 
From (|4.4[) and the fact that f k , k < N are continuous functions, it follows that 

A' 

2' : 



(4-9) P( C) >!_£*>!_, 



Observe that (|4.4|) also implies that a.s. p n (ui) = p(u>) for sufficiently large n (which 
depends on u). Thus from property (ii) we get 

H(er, p, U)l C > lim sup H (n) (ct„ , p„ , Z {n) )l c 

n— >oo 

where Z^ = (Z { ™\ ..., zffl). Since H and H^ are uniformly bounded by A then 
from Fatou's lemma we derive 

(4.10) EW(a,p,U)I c > lim sup EM { - n \a n ,p n , Z (n) )I c . 

n—¥oo 

Finally, let Q be the distribution of (Uo, ..., Un)- From (I) it follows that QeM 
is a martingale distribution. It is well known that for Dynkin games the inf and 
the sup can be exchanged (for details see [15]). Thus from (|4.3|) - (|4.4|) . (|4.7|) for 
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L fc = H{a, k, U) and (|48l) -(|4l0 j) we get 

su PreA4 su Prer inf <?eT E P H(cr, r, Z) > sup TeT[/ inf aeTu EM(a, r, [/) 

= mi aeTu sup reTLr ffl(<r, r, U) > inf CTer[ 7 EU(a, p, U) 

> EB.{jJ, p, U)l c - e > Iirnsup,^ EM^(a n ,p n , Z^)l c - e 

> limsup„^ 00 MH(")(cw„, ZW) - .Ae - e 

> limsup n _^ 0O sup Pew v(Sup T6T -ii)f o -g7-EpH( n )(<r,T,Z) - e(*4.+ 1), 



and since e was arbitrary we obtain (I4.2[) as required. The reason that we have 
lim sup in the above equation and not lim inf as in (|4.2p , is because we passed to a 
subsequence, but left the same notations. □ 

Remark 4.2. Let us notice that in order to obtain Lemma J±.l we used a stronger 
form of the standard weak convergence. Namely we also required a convergence 
of the conditional distributions. This is the discrete analog of the extended weak 
convergence which introduced by Aldous in [T] for continuous time processes. In 
general, the standard weak convergence is not sufficient for the convergence of the 
corresponding optimal stopping and Dynkin games values. 
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